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TITLE OF THE INVENTION 
METHOD AND APPARATUS FOR PRESERVING, ENLARGING AND SUPPLEMENTING 
IMAGE CONTENT DISPLAYED IN A GRAPHICAL USER INTERFACE 

5 

BACKGROUND OF THE INVENTION 

FIELD OF THE INVENTION 

The present invention generally relates to a graphical user interface (GUI) for 
1 0 controlling the display of a digital image, and providing GUI features which allow a user to 
reformat the image so that the user can concentrate on a portion of the image that is of 
particular interest, while preserving the remaining portion of the image. 

q BACKGROUND INFORMATION 

jt5 In a CATV system, an electronic program guide (EPG) is used by a viewer to 

^ determine what programs are available for viewing on a television, at what time the programs 

will be broadcast, and on which channels. More sophisticated EPGs display supplemental 
□ information used by the viewer to determine whether the program is suitable for young 
^rj children, what actors are in the program, how long the program is, and what the program is 
38) about. Normally in an EPG, an individual windowed portion is allocated for each program 
\,2 displayed. 

Viewers of CATV programs use a GUI to navigate an EPG and select program 
windows in the EPG that are of particular interest. When viewing the EPG at a considerable 
distance from the television set, it is often difficult for a viewer to discern the text and/or 
25 images in the individual windows of the EPG. 

U.S. Patent No. 5,754,348 (Soohoo) discloses magnifying a selected region of an 
image while simultaneously preserving the continuity and integrity of the original unmagnified 
image that forms the visual content of the magnified region. Using Soohoo's method, a selected 
region of an original image is determined, the selected region image data is copied and 
30 magnified, and the floating plane region containing the magnified image data is displayed such 
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that it covers an area of the original image that is larger than the selected region. Thus, the use 
of Soohoo ! s method obstructs a portion of the original image from being viewed. 

FIG. 1 illustrates a prior art system 100 comprising a display 105 showing an 
original image 110. The original image is shown in text format, but it is understood that any 
5 image(s) may be included in the original image. 

FIG. 2 illustrates a prior art system 200 comprising a display 220 showing an 
original image 205. A selected portion 215 of the original image is shown. Prior art system 
200 superimposes a magnified image 215 over the original image 205 without modifying the 
original image 205. There is information in the superimposed magnified image 215 that also 
10 appears in the original image 205, which can both be seen simultaneously if the window is not 
directly superimposed over the selected portion 210. 

FIG. 3 illustrates a prior art system 300 having a magnified image 310 superimposed 
; s rf over an original image 305. In this case, a window displaying the magnified image 310 is 
=IS transparently superimposed over the original image 305 such that both images 305 and 3 10 may 
j£5 be simultaneously viewed. Magnified image 3 1 0 is displayed in a floating plane region in a 
: ■ ■ / partially transparent format, so that a portion of the original image covered by the floating plane 
j y region can still be viewed. However, in situations where it is desired to enlarge a portion of the 
q original image having a dense concentration of text and/or image data, it would be difficult, if 
not impossible, to discern what appears behind the floating plane image. 

SUMMARY OF THE INVENTION 
The present invention includes a method and apparatus for preserving, enlarging and 
supplementing image content displayed in a graphical user interface (GUI), such as an 
electronic program guide (EPG), or the like. 

25 The present invention enlarges a digital image displayed in a graphical user interface 

(GUI). The present invention selects for enlargement a portion of an original image displayed 
in the GUI and displays, adjacent to an enlarged image of the selected portion, an image of the 
remaining portion(s) of the original image that was not selected for enlargement. When one of 
the image portions is selected, the remaining selectable image portion(s) that was not selected is 

30 displayed adjacent to an enlarged image of the selected portion. The remaining portion does 
not include the image data that is displayed by the enlarged image and thus there is no 
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redundancy in the data displayed by the adjacent image portions. Further, the remaining 
portion is not obscured by the enlarged image, and the enlarged image is not transparently 
superimposed on the remaining portion. 

The present invention displays an enlarged portion of the original image adjacent to 
a remaining portion of the original image that was not selected for enlargement. The present 
invention may store image data of the selected portion in a first memory location and store 
image data of the remaining portion in a second memory location. 

The image data of the selected portion is retrieved from the first memory location, 
the image data of the remaining portion from the second memory location is retrieved from the 
second memory location, and the retrieved image data is reconfigured such that the remaining 
portion image is displayed adjacent to an enlarged image of the selected portion, and the GUI is 
instructed to display a modified image based on the reconfigured image data. 

In a first embodiment of the present invention, a table that correlates hidden 
supplemental data with selected image portion identification data is stored in a third memory 
location. The present invention may search the third memory location to determine if there is 
hidden supplemental data that corresponds to the selected portion, incorporate any hidden 
supplemental data found in the third memory location that corresponds to the selected portion 
into the enlarged image, and instruct the GUI to display the enlarged image including the 
hidden supplemental data. 

The enlargement feature may be controlled by an infrared (IR) remote control 
operated by the subscriber. The enlargement feature may be controlled by a wireless pointing 
device operated by the subscriber. The pointing device may be a mouse having two buttons 
which, each of which when depressed, implement different features of the present invention. 
A floating plane region may be superimposed on the original image in the GUI. The floating 
plane region moves in accordance with a change of the selected portion, and the enlarged image 
of the selected portion is modified to correspond to the current selected portion. 

The present invention also displays an original image having a plurality of image 
portions selectable for enlargement. When one of the image portions is selected, the selectable 
image portions that were immediately adjacent to the selected image portion prior to being 
enlarged are either displayed or hidden, depending on which image portion is selected and how 
the enlargement of the selected image portion is configured. 
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The apparatus of the present invention includes a first and second memory location 
and a processor. The first memory location stores image data of a portion of an original image 
displayed in the GUI and selected for enlargement. The second memory location stores image 
data of the remaining portion of the original image that was not selected for enlargement. The 
processor (i) retrieves the image data of the selected portion from the first memory location, (ii) 
retrieves the image data of the remaining portion from the second memory location, (iii) 
reconfigures the image data such that the remaining portion is displayed adjacent to an enlarged 
image of the selected portion, and (iv) instructs the GUI to display a modified image based on 
the reconfigured image data. The remaining portion is not obscured by the enlarged image, and 
the enlarged image is not transparently superimposed on the remaining portion. 

In accordance with the first embodiment described above, the apparatus of the 
present invention includes a first and second memory location, and a processor. The first 
memory location stores image data of a portion of an original age displayed in the GUI and 
selected for enlargement. The second memory location stores a table that correlates hidden 
supplemental data with selected image portion identification data. The processor (i) searches 
the second memory location to determine if there is hidden supplemental data that corresponds 
to the selected portion, (ii) incorporates any hidden supplemental data found in the second 
memory location that corresponds to the selected portion into the enlarged image, and (iii) 
instructs the GUI to display the enlarged image. The incorporated hidden supplemental data is 
revealed by the enlarged image. 

In a second embodiment of the present invention, a service provider may offer a 
subscriber access to an enlargement feature of the GUI described above. In response to the 
subscriber accepting the offer, an enlargement feature application program is downloaded to a 
local device that controls the GUI. The enlargement feature may be operated in conjunction 
with an electronic programming guide (EPG) or an integral part of another EPG version. The 
service provider may be a multiple system cable operator (MSO), and the local device may be a 
set-top box in communication with a remote server maintained by the MSO and a television. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
The following detailed description of preferred embodiments of the present 
invention would be better understood when read in conjunction with the appended drawings. 
For the purpose of illustrating the present invention, there are shown in the drawings 
embodiments which are presently preferred. However, the present invention is not limited to 
the precise arrangements and instrumentalities shown. In the drawings: 
FIG. 1 shows a prior art display of an original image. 

FIG. 2 shows a prior art GUI display where a selected portion of the original image 
is selected and a magnified image is superimposed on the original image. 

FIG. 3 shows a prior art GUI display where a magnified image of the selected 
portion is transparently superimposed on the original image. 

FIG. 4 shows an original image prior to a particular portion of the original image 
being selected for enlargement in accordance with the present invention. 

FIG. 5 shows a reconfigured version of the original image with an enlarged image 
portion displayed adjacent to the remaining portion of the original image that was not selected 
for enlargement in accordance with the present invention. 

FIG. 6 shows an electronic programming guide (EPG) with a plurality of selectable 
windows, each containing information about different programs in accordance with the present 
invention. 

FIG. 7 shows a reconfigured version of the EPG with an enlarged window 
containing selected program information displayed adjacent to the remaining program windows 
that were not selected for enlargement in accordance with the present invention. 

FIG. 8 shows a flow chart in accordance with the present invention. 

FIG. 9 shows a CATV system in accordance with the present invention. 

FIG, 10 shows a table stored in a memory location used for determining whether 
hidden supplemental data is to be displayed when a corresponding image portion is selected in 
accordance with the present invention. 

FIG. 1 1 shows a CATV system that allows a subscriber to add an enlargement 
feature to a local device used by the subscriber in accordance with the present invention. 

FIG. 12A shows an original image with an image portion selected for enlargement. 
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FIGs. 12B, 12C and 12D show examples of how the image display may appear after 
particular selectable image portions of an original image are selected for enlargement. 

DETAILED DESCRIPTION OF THE INVENTION 

The present invention enlarges a selected portion of a displayed image and displays 
the enlarged selected portion adjacent to the remaining portion of the image that was not 
enlarged. In order to fit the enlarged image portion and the remaining image portion on the 
same display screen without any overlapping, the present invention stores and reconfigures 
image data associated with the selected image portion and the remaining image portion. 

FIG. 4 illustrates a GUI display 400 in accordance with the present invention. 
Included on the GUI display 400 are four substantially equal-sized image portions, a first 
portion 405, a second portion 410, a third portion 415, and a fourth portion 420. Image data 
associated with portions 405, 410, 415 and 420 is stored in memory. Once one of the image 
portions is selected for enlargement, the stored image data is retrieved from memory, 
reconfigured, and displayed in accordance with the present invention. 

FIG. 5 shows a system display 500 after a first portion 520 is selected for 
enlargement. Note that image portions 505, 510 and 515 may remain the same size or may be 
reduced in size, depending on the room available on the display. Image portion 520 is enlarged 
to allow a viewer a clear image while still allowing the viewer to discern the other non-enlarged 
(or reduced) image portions. 

FIG. 6 shows an electronic programming guide (EPG) 600. EPG 600 is shown with 
four program windows 605, 610, 615 and 620. A television viewer may select a particular 
program window for enlargement by selecting one of the windows 605, 610, 615 and 620 by 
utilizing a wireless pointing capability that may be built into an infrared (IR) remote control, 
wireless mouse, Web pad, or the like, 

FIG. 7 shows an EPG 700 after a program window 720 has been selected for 
enlargement. Program window 720 is displayed adjacent to windows 705, 710 and 715 which 
were not selected for enlargement. Once enlarged, window 720 is illustrated as displaying 
additional supplemental data about the program associated with the program window selected. 

Referring now to FIG. 8 which represents one of the exemplary embodiments of the 
present invention, an original image having selectable image portions is displayed (step 805). 
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One of the selectable image portions is selected for enlargement (step 810). Image data 
associated with the selected image portion is stored in a first memory location (step 815). 
Image data associated with the remaining selectable image portion(s) is stored in a second 
memory location (step 820). A table correlating hidden supplemental data with selectable 
image portion identification data is stored in a third memory location (step 825). Image data 
associated with the selected image portion is retrieved from the first memory location (step 
830). Image data associated with the remaining selectable image portion(s) is retrieved from 
the second memory location (step 835). A search is performed in the third memory location for 
hidden supplemental data that corresponds to the selected image portion and is retrieved if 
found (step 840). The image data retrieved from the first, second and third memories is then 
reconfigured by a processor (step 845). Finally, the image data associated with the remaining 
image portion(s) is displayed adjacent to an enlarged image of the selected image portion which 
includes any hidden supplemental data found in the third memory location (step 850). 

The remaining image portion(s) does not include the image data displayed by the 
enlarged image. The selection of an image portion for enlargement may be implemented by 
utilizing a wireless pointing capability that may be built into an infrared (IR) remote control, 
wireless mouse, Web pad, or the like. The display of the enlarged image portion including the 
hidden supplemental data adjacent to the remaining image portion(s) may then be implemented 
by depressing a second button on the mouse. As previously discussed, the remaining portion is 
not obscured by the enlarged image, and the enlarged image is not transparently superimposed 
on the remaining portion. 

Referring now to FIG. 9 which represents another exemplary embodiment of the 
present invention, a CATV system 900 is shown which includes a service provider node 905, a 
local device 910, a display 915 and a wireless GUI controller 920. The service provider node 
905 may be a multiple system cable operator (MSO). The local device 910 may be a set-top 
box in communication with a remote server maintained by the service provider node 905 and 
the display 915, which may be a television. Local device 910 includes a processor 925, a first 
memory location 930, a second memory location 935 and a third memory location 940. EPG 
data is transmitted from the service provider node 905 (e.g., headend) to the processor 925 
within local device 910. The EPG data is displayed, in whole or in part, on display 915. 
Processor 925 parses through the EPG data received and creates a table of hidden supplemental 



Attorney Docket 
* No. 10622-9US 

data that would normally have to be displayed in such a small font that it would be almost 
impossible for a viewer to see the data at a reasonable distance from the display 915. Image 
portion selections may be made directly via GUI controller 920 by utilizing a wireless pointing 
capability that may be built into an infrared (IR) remote control, wireless mouse, Web pad, or 
5 the like. Image data associated with the selected image portion is stored in the first memory 
location 930. Image data associated with the remaining displayed image portion(s) is stored in 
the second memory location 935. A search is then performed on the third memory location 940 
to determine if there is hidden supplemental data associated with the selected image portion. 
The first, second and third memory locations, 930, 935, and 940, can reside in processor 925 or 
10 in another processor that communicates with processor 925. 

FIG. 10 represents another exemplary embodiment of the present invention for 
which a table 1000 is used to determine whether there is hidden supplemental data associated 
, J with a selected image portion. Each selectable image portion is assigned an identification 
^ parameter 1005 (in this example: IDs 1, 2, 3 and 4 have been assigned). When a particular 
|A5 image portion is selected by a user who views data displayed in the selected image portion 1010 
P (e.g., "I Love Lucy"), the table 1000 residing in memory location 940 is searched and, if found, 
i « hidden supplemental data 1015 that correlates to the selected image portion (e.g., Episode #27 

Q "The Kleptomaniac" - Ricky Discovers a Large Amount of Cash in Lucy's Purse) is displayed 

nn 

jS] in an enlarged window that was not displayed in the selectable image portion window, along 

59) with the data originally displayed in the selected image portion window. 

j,* FIG. 1 1 represents another exemplary embodiment which incorporates the features 

of the present invention into a subscriber's local device. A service provider 1 105 (e.g., MSO) 
offers an enlargement feature to a user of a local device 1110 (e.g., a set-top box). The offer is 
presented by displaying the offer on a television 1 1 1 5 via the local device 1110. The subscriber 

25 is given the opportunity to accept the offer by pressing one or more buttons on the local device 
1 1 10, a wireless GUI, or by placing a telephone call to the service provider or a third party 
representative. Upon acceptance of the offer by the subscriber and processing by the service 
provider, an enlargement feature application program is downloaded from the service provider 
1 105 to the local device 1 1 10 and stored in a memory and/or processor within the local device 

30 1110. 
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FIGs. 12A-12D represent another exemplary embodiment of the present invention 
which is used to select an image portion for enlargement. 

As shown in FIG. 12 A, the selection of a particular image portion for enlargement 
may be implemented by the user selecting one of a plurality of image portions P1-P25 
5 contained by an original image viewed on display 1200. The selection of region 1205 in the 
GUI may be accomplished in a number of ways, such as by superimposing a floating plane 
region on one of image portions P1-P25, or by utilizing a wireless pointing capability that may 
be built into an infrared (TR) remote control, wireless mouse, Web pad, or the like. 

FIGs. 12B-12D illustrate that the location of the selectable region changes in 
1 0 accordance with which portion P 1 -P25 of the original image is selected for enlargement. 

As shown in FIG. 12B, an enlarged image 1205' of selected image portion PI 3 is 
viewed on display 1200'. The image portions P1-P12, P14 and P16-P20 that were immediately 
5 adjacent to selected image portion P 1 3 prior to being enlarged, are positioned to surround the 
$ enlarged image portion viewed on display 1200' such that these adjacent image portions retain 
;Jb5 their relative positions when compared to the original image. Image portions P 1 5 and P2 1 -P25 
?! are hidden from view. 

1 y As shown in FIG. 12C, when the selectable region is moved from selected image 

□ portion P 1 3 to image portion P 1 2, an enlarged image 1 2 1 0 of selected image portion P 1 2 is 
|:J viewed on display 1200". The image portions Pl-Pl 1, P13, P14 and P16-P20 that were 
SB) immediately adjacent to selected image portion P 12 prior to being enlarged, are positioned to 
£ surround the enlarged image portion viewed on display 1200" such that these adjacent image 
portions retain their relative positions when compared to the original image. Image portions 
PI 5 and P21-P25 are again hidden from view. 

As shown in FIG. 12D, when the selectable region is moved from selected image 
25 portion P12 to image portion P17, an enlarged image 1215 of selected image portion P17 is 
viewed on display 1200'". In this example, the image portions P6-P16, P18, P19 and P21-P25 
that were immediately adjacent to selected image portion P17 prioj to being enlarged, are 
positioned to surround the enlarged image portion viewed on display 1200"' such that these 
adjacent image portions retain their relative positions when compared to the original image. 
30 Image portions P 1 -P5 and P20 are hidden from view. 
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The present invention may be implemented with any combination of hardware and 
software. If implemented as a computer-implemented apparatus, the present invention is 
implemented using means for performing all of the steps and functions described above. 

The present invention can be included in an article of manufacture (e.g., one or more 
computer program products) having, for instance, computer useable media. The media has 
embodied therein, for instance, computer readable program code means for providing and 
facilitating the mechanisms of the present invention. The article of manufacture can be 
included as part of a computer system or sold separately. 

It will be appreciated by those skilled in the art that changes could be made to the 
embodiments described above without departing from the broad inventive concept thereof. It is 
understood, therefore, that this invention is not limited to the particular embodiments disclosed, 
but it is intended to cover modifications within the spirit and scope of the present invention as 
defined by the appended claims. 
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